Fusing Audio-visual Nonverbal Cues to Detect Dominant People in Conversations
نویسندگان
چکیده
This paper addresses the multimodal nature of social dominance and presents multimodal fusion techniques to combine audio and visual nonverbal cues for dominance estimation in small group conversations. We combine the two modalities both at the feature extraction level and at the classifier level via score and rank level fusion. The classification is done by a simple rulebased estimator. We perform experiments on a new 10hour dataset derived from the popular AMI meeting corpus. We objectively evaluate the performance of each modality and each cue alone and in combination. Our results show that the combination of audio and visual cues is necessary to achieve the best performance.
منابع مشابه
Fusing Audio-Visual Nonverbal Cues to Detect Dominant People in Small Group Conversations
This paper addresses the multimodal nature of social dominance and presents multimodal fusion techniques to combine audio and visual nonverbal cues for dominance estimation in small group conversations. We combine the two modalities both at the feature extraction level and at the classifier level via score and rank level fusion. The classification is done by a simple rulebased estimator. We per...
متن کاملMultimodal analysis of small-group conversational dynamics
The analysis of conversational dynamics in small groups, like the one illustrated in Figure 1.1, is a fundamental area in social psychology and nonverbal communication [Goodwin, 1981, Clark and Carlson, 1982]. Conversational patterns exist at multiple time scales, ranging from knowing how and when to address or interrupt somebody, how to gain or hold the floor of a conversation, and how to make...
متن کاملComputational modeling of face-to-face social interaction using nonverbal behavioral cues
The computational modeling of face-to-face interactions using nonverbal behavioral cues is an emerging and relevant problem in social computing. Studying face-to-face interactions in small groups helps in understanding the basic processes of individual and group behavior; and improving team productivity and satisfaction in the modern workplace. Apart from the verbal channel, nonverbal behaviora...
متن کاملAttentive Headphones: Augmenting Conversational Attention with a Real World TiVo
Computer users in public transportation, coffee shop or cubicle farm environments require sociable ways to filter out noise generated by other people. Current use of noisecanceling headsets is detrimental to social interaction because these headsets do not provide context-sensitive filtering techniques. Headsets also provide little in terms of services that allow users to augment their attentiv...
متن کاملChildren use nonverbal cues to make inferences about social power.
Four studies (N = 192) tested whether young children use nonverbal information to make inferences about differences in social power. Five- and six-year-old children were able to determine which of two adults was "in charge" in dynamic videotaped conversations (Study 1) and in static photographs (Study 4) using only nonverbal cues. Younger children (3-4 years) were not successful in Study 1 or S...
متن کامل